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@ Distributed management communications network. 

(57) A multinode, multicast communications net- 
work has a distributed control for the creation, 
administration and operational mode selection 
operative in each of the nodes of the network. 
Each node is provided with a Set Manager for 
controlling either creation of, administration or 
access to a set of users to whom a multicast is 
to be directed. The Set Manager maintains a 
record of the local membership of all users 
associated with the node in which the Set Man- 
ager resides. A given Set Manager for each 
designated set of users is assigned the task of 
being the Set Leader to maintain membership 
information about the entire set of users in the 
multicast group. One of the Set Managers in the 
communications network is designated to be 
the Registrar which maintains a list of all the Set 
Leaders in the network. The Registrar insures 
that there is one and only one Set Leader for 
each set of users, answers inquiries about the 
membership of the sets and directs inquiries to 
appropriate Set Leaders if necessary. All of the 
set creation, administration and control func- 
tions can therefore be carried out by any node 
of the system and provision is made to assume 
the function at a new node when failure or 
partition in the network occurs. 



FIG. 2A 
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This invention relates to digital communication 
systems in general and specifically to packet trans- 
mission systems involved in the management of mul- 
ticast communications to a plurality of users. 

Packet transmission systems in data communica- 5 
tions networks have become commonplace in provid- 
ing communications of digital data between process- 
ing centers and communications users. Such systems 
include a plurality of packet switching nodes intercon- 
nected with the various transmission links. Digital in- 10 
formation is transmitted in such systems by dividing 
it into a number of packets, each packet having a 
header with all of the routing information necessary 
to control the switching nodes which the packet will 
encounter in its trip through the network from an orig- 15 
inating node to a final destination or destinations. 
Packet networks originally were created for closely 
located data processing sites. However, packet net- 
works are now being used in large, widely distributed 
data processing networks of national and inter nation- 20 
al scope. 

Routing protocols or methods are used to control 
the routing of the data packets from node to node or 
switch to switch through the packet transmission sys- 
tems. Generally, each packet has a header that in- 25 
eludes the routing addressing or control information 
necessary to direct the packet's progress from the 
originating node to the destination node or nodes. In 
multicast routing, as addressed in the present inven- 
tion, routing distribution trees may be defined as a 30 
connected set of network nodes and links in which a 
single sender transmits the same information packets 
to a multiplicity of receiving nodes. Multicast tree ad- 
dressing utilizes a tree address in the routing field of 
the packet header to direct the packet to an entire 35 
group of destination nodes. When such a packet 
reaches a packet switching node, the tree address in 
the packet header is compared to tree addresses 
known to the node and if a match occurs, the packet 
will be forwarded on all the transmission links con- 40 
nected to that node for which a match occurs. Multiple 
copies of a packet may thus be generated at each 
switching node to accommodate the multicast tree 
distribution plan. 

Multicast tree routing has thus become a com- 45 
mon method of communicating over a packet trans- 
mission network because of the efficiencies involved 
in utilizing a multicast tree distribution protocol. Multi- 
cast tree routing involves the creation and mainte- 
nance of a set of packet users who wish to communi- 50 
cate among themselves and also involves the deter- 
mination of and maintenance of the optimum path for 
connecting the set of users to one another as has 
been common in the prior art 

In such systems, however, numerous problems 55 
arise if the set or group of users changes or when 
hardware failures occur that cause partition in the dis- 
tribution network. The traditional approach to such 



problems has been to have a centralized database 
and control which monitors for such conditions in the 
network so that effective recovery actions may be 
taken. Unfortunately, this involves the periodic send- 
ing and retrieval of status information which, in a large 
and distributed network, requires a considerable ded- 
ication of the bandwidth of the communication sys- 
tem to strictly management functions involved in re- 
porting status and monitoring the activities. If a more 
real-time management capability is desired, continu- 
ous monitoring and sending of status messages may 
be required and this is not only difficult to administer, 
but is quite consumptive of transmission resource. 
Such systems become unwieldy or even intolerable 
where numerous, real-time messages must be trans- 
mitted such as in the case of multi-media audio and 
video systems in which the audio and video data must 
be synchronized in their transmission and receipt at 
the various nodes. 

In view of the foregoing known difficulties with 
the prior art multicast networks and distribution 
schemes, it is an object of the present invention to 
provide a new form of communication network and 
control in which each of the users having membership 
in a multicast set is controlled and administered inde- 
pendently from the creation and utilization of the dis- 
tribution or transmission paths used to communicate 
among the members of the set. 

Yet another object of the invention is to provide a 
distributed control over the sets of users or groups in 
a multicast network by providing at ail of the commu- 
nicating or switching nodes in the network the capa- 
bility for creation, administration and control over the 
user sets. 

In accordance with a preferred embodiment of 
the invention that will be illustrated herein, the prob- 
lems involved in the creation and control of multicast 
distribution within a digital packet network are solved 
by separating the administration and control of user 
groups who wish to communicate in a multicast sys- 
tem from the administration and control of the com- 
munication paths making up the multicast network it- 
self. Control over the user groups or sets is facilitated 
by providing at each node in the network the full 
menu of capabilities required for the creation of, ad- 
ministration of and control of the user groups or sets. 

The chief characteristic for providing these capa- 
bilities is herein called a "Set Manager" (SM), one Set 
Manager being located at each node in the network. 
The Set Manager maintains a record of all of the local 
memberships of users in sets which it serves. The 
users are called Transmission Users (TUs) associat- 
ed with the node where each Set Manager function 
resides. A Set Manager for each set is designated as 
a Set Leader (SL). The Set Leader maintains the 
membership information about the entire set of TUs 
in a given group, not just any local members served 
by the node which is acting as set leader. In addition, 
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one Set Manager in the packet communications net- 
work at an arbitrary node is designated as Registrar 
(R). The Registrar maintains a list of a!! the Set Lead- 
ers for all of the multicast user sets or groups that may 5 
be defined in a given network. The Registrar's func- 
tion is to insure that there is one and only one Set 
Leader in each set or group of users designated to an- 
swer the inquiries about the set's membership or to 
direct inquiries to an appropriate Set Leader if the in- w 
formation happens to not be available at the Regis- 
trar. All of these set creation and administration func- 
tions may be carried out at any node in the system 
and provision is made to allow another node to as- 
sume the functions of an acting Set Leader or Regis- 15 
trar when failures in the network that cause partitions 
or other disruption occur. 

Efficient protocols for the communication of con- 
trol and coordination information among the Set Man- 
agers at the various nodes in the network greatly re- 20 
duce the system resource overhead dedicated to 
maintaining status information since each Set Man- 
ager fulfills a portion of set management and commu- 
nications management functions with only a limited 
need to communicate with other Set Managers or 25 
functions to perform its duty. 

The foregoing and still other objects of the inven- 
tion that have not been specifically enumerated are 
provided in a preferred embodiment further described 
and illustrated with respect to the drawings in which: 30 

Figure 1A illustrates a typical schematic view of 
a prior art orthogonal switching network comprised of 
a plurality of nodes, each node having an associated 
host processor or computer. 

Figure 1B illustrates a prior art typical switching 35 
or routing node containing one or more decision or 
switching points. 

Figure 1C illustrates an individual decision point 
from such a prior art node but including the set man- 
agement processes and capabilities to make a given 40 
node effective as a Set Manager in accordance with 
the preferred embodiment of the present invention. 

Figure 1D illustrates schematically a network 
comprised of nodes A-L with some of the nodes hav- 
ing attached transmission users identified by links to 45 
the small letter u. 

Figure 2A schematically illustrates protocol mes- 
sage flow between various functional units designat- 
ed the Set Manager, a Transmission User, Registrar, 
Set Leader or Surrogate Set Leader in accordance so 
with the present invention. 

Figure 2B illustrates the specific message flows 
in the protocols to manage the network with distrib- 
uted Set Mangers operating in various capacities in 
accordance with the preferred embodiment of the in- 55 
vention. 

Figure 3 illustrates schematically a network con- 
figured in accordance with the preferred embodiment 
in which a partition into two portions occurs by virtue 



of a break in a link in the communications network. 

Figure 4 illustrates a recovery from a network fail- 
ure causing partition in the network in accordance 
with the present invention. 

Figure 5 illustrates a flowchart of the protocol and 
process invoked by a Set Manager at each node for 
the functions of enrolling a transmission user served 
by the node into a group multicast set, resignation of 
a user from a set, joining of a transmission user into 
a set as communicated to a Set Leader or the receipt 
of a topological database update message indicating 
the Set Leader has failed. 

Figure 6 illustrates the procedural flow invoked 
when a Set Leader is not known for a given set by a 
Set Manager. 

Figure 7 illustrates the various Set Manager con- 
trol modes that may be invoked at any Set Manager 
to become a Set Leader, a Registrar or a Surrogate 
in accordance with the preferred embodiment of the 
invention. 

Figure 8 schematically illustrates the layout com- 
prised of Figures 8A and 8B. 

Figures 8Aand 8B schematically show the proce- 
dural flows and protocol when a Set Manager be- 
comes the Set Leader. 

Figure 9 illustrates the procedural flows invoked 
when a Set Manager becomes the Registrar for the 
network in accordance with the preferred embodi- 
ment of the invention. 

Figure 10 illustrates the procedural flows and 
protocols in a preferred embodiment of the invention 
when a Set Manager becomes a Surrogate Set Lead- 
er. 

As noted above, control of the network in the pre- 
ferred embodiment of the invention is facilitated by 
providing user set creation, administration and control 
capabilities in all of the nodes of the packet commu- 
nications network. The chief characteristic of these 
capabilities is summarized as a Set Manager (SM) lo- 
cated at each node. The SM maintains a record of all 
the local Transmission Users (TU) who are members 
in the user groups or sets and which are served local- 
ly by the node,in which the Set Manager resides. 

One SM for each user group or set is designated 
as the Set Leader (SL). The SL maintains member- 
ship information about the entire set of TUs in a given 
group or set, not only the local members served by 
that particular Set Manager. 

Finally, one SM in the network is designated as 
a Registrar (R). The Registrar maintains a list of all of 
the SLs in the network and of their user lists. The 
function of the Registrar is to insure that there is only 
one Set Leader for each user group or set and to an- 
swer inquiries regarding the set membership or to di- 
rect such inquiries to an appropriate Set Leader if the 
information happens not to be available at the the 
Registrar. All or any subset of these several adminis- 
tration functional designations may be implemented 
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and carried out by any node of the system, i.e. net- 
work. Provision is made at each node to assume the 
functions of a failing node when failures of a node oc- 
cur or a network partition occurs due to failure of a 
communication link. 

Prior to illustrating the preferred embodiment in 
detail, some background terminology and information 
is necessary. Figure 1 A illustrates the schematic lay- 
out of a typical packet communications network of t he 
prior art in which a plurality of nodes N f are intercon- 
nected by communication links, each node being 
served by an associated host processor or computer 
Hj which contains or has access to the network con- 
figuration topology database (Figure 1C) and which 
contains the appropriate control process code to per- 
form the functions required to control the switching 
and communication at each node Nj. 

Figure 1B illustrates the typical prior art node H t 
in greater detail showing that a plurality of decision 
points Dpi may be included in each node. The decision 
points are the route switching decisions made by the 
node to determine that an incoming message on one 
link is destined for one or more outbound links de- 
pending upon routing information contained in a pack- 
et message. 

Figure 1C illustrates a typical decision point DP} 
in greater detail showing that a switching fabric is 
used to interconnect one or more user applications 
addressed through application adapters to one or 
more incoming or outgoing transmission links via 
transmission adapters. The management of the 
switching fabric is under the control of the host com- 
puter Hj which has access also to set management 
processes for groups of users in a multicast set and 
to the network topology database for determining the 
addresses, locations, etc. of the members of a group 
or groups within the network. 

In accordance with the preferred embodiment of 
the present invention, multicast user sets or groups of 
TUs may be created at will by any TU in the network. 
Such sets may be "open", in the sense that terminal 
nodes or user nodes can join or leave the set at any 
time and at their own volition or "closed" in the sense 
that membership is limited to a preselected set of 
users arbitrarily dictated by the user which formed or 
created the initial set In the present embodiment of 
the invention, distributed control over the creation, 
administration and of multicast user groups or sets is 
defined by a set of protocols and processes resident 
in each node either as shown by the set management 
processes in Figure 1C or contained within the host 
Hj serving the node. Partition of the network caused 
by link failures may be noted by monitoring messages 
transmitted between Registrar, Set Leaders and TUs 
in accordance with the preferred embodiment of the 
invention. If a failure results in partition of a transmis- 
sion user group or set, the separated subsets so 
formed must be reconstituted into separate sets hav- 



ing their own Set Leaders and Registrars. To this end, 
the Registrar in the original network detects the loss 
of a Set Leader and deletes that Set Leader from its 

5 list of Set Leaders. When a Set Leader detects the 
loss of the Registrar, the Set Leader contends for and 
may actually become the Registrar itself for its own 
network subset. If it does become Registrar, it accu- 
mulates all of the necessary information from the Set 

w Leaders which it serves. When a Set Leader detects 
the loss of a Transmission User or Set Manager, the 
Set Leader alters the membership in its set by delet- 
ing the affected user or users. Finally, a Set Manager 
which detects the loss of its Set Leader may become 

15 the Set Leader itself and accumulate all of the neces- 
sary information from users that it will serve. The ac- 
tions in these various functional capacities take place 
automatically in accordance with a preferred embodi- 
ment of the invention by following methods described 

20 by procedural flowcharts implemented in appropriate 
control instructions accessed by and executed by the 
host compute at each node. 

When failure in a link is repaired and subsets are 
to be joined or reunited into a complete user set, one 

25 of the Registrars will be redundant and must be arbi- 
trarily removed. The Set Leaders registered with the 
deleted Registrar must then register with the original 
Registrar and send their membership lists to it. One 
subset Set Leader must also surrender its set leader- 

30 ship to the other subset Set Leader upon rejoinder of 
the network partitions. To accommodate transmis- 
sion users who will still not be aware of the change in 
set leadership, the deleted Set Leader will become a 
Surrogate Set Leader and forward the set member- 

35 ship list to the actual Set Leader, thus making an in- 
stantaneous reformation of all of the sets unneces- 
sary since the system or network may recover and re- 
form over time without creating a sudden avalanche 
of messages transferring leadership, member lists, 

40 etc. 

Returning to Figure 1A, a general schematic 
block diagram of a typical packet communications 
network having a number of routing nodes ar- 
ranged in a regular two dimensional lattice is shown. 

45 The nodes Nj may. however, be arranged in any 
graphically interconnected arrangement with each 
node having a plurality of incoming transmission 
lengths and a plurality of outgoing transmission links 
and with the pluralities of incoming and outgoing links 

50 being not necessarily equal. Each node Nj is also as- 
sociated with a host computer Hi which performs all 
of the storage, routing and control functions neces- 
sary to the operation of the switching node. Each 
node, as directed and controlled by its respective as- 

55 sociated host computer, is capable of routing data 
packets from any of its incoming connected transmis- 
sion links to any of the outgoing transmission links or 
to any group of them. 

As shown in Figure 1 B, each node comprises one 
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or more decision poings DP, which in turn are dis- 
closed in more detail in Figure 1 C which also includes 
portions of the preferred embodiment of the inven- 
tion. 5 

In a packet communications network such as 
shown in the prior art Figure 1A, routes for packets 
are calculated before sending such packets into the 
network, but the actual communication links intercon- 
necting the nodes may not be dedicated to that pack- 1 o 
et until its receipt is detected at a given switching 
node. Each link in the route will then be designated 
in response to routing information contained in the 
header portion of the packet Incoming data packet 
headers at a given node are examined to determine 15 
the appropriate outgoing transmission link or paths 
on which the packet should be forwarded. In re- 
sponse to the header information, the packet will be 
actually connected and distributed to the appropriate 
outgoing links or links at a decision point DPj or points 20 
within the node. 

Decision points DP ( within a node are shown in 
Figure 1B. Each of the switching nodes comprises 
one or more subnode decision points DP t , each hav- 
ing a plurality of incoming transmission paths and a 25 
plurality of outgoing transmission paths. Packets to a 
subnode decision point DPj may come from remote 
switching nodes in the network, from decision points 
within the same switching node, or from user applica- 
tions (TUs) accessing the packet network at that giv- 30 
en switching node Nj. The availability of more than 
one decision point allows each node N ; to handle any 
number of incoming or outgoing transmission links 
since each link may be multiplied by connection to an- 
other decision point. A large plurality of local user ap- 35 
plications can therefore be accessed through each 
switching node by the use of the multiple switching 
points. 

As shown in Figure 1C, a typical subnode packet 
decision point DPj from Figure 1B may comprise a 40 
patching or switching fabric SW and a plurality of 
adapters which may be selectively interconnected by 
the switching fabric. "Switching fabric" is a term of art 
intended to identify any mechanism for providing ap- 
propriate receipt from and distribution onto one or 45 
more paths of digital signals. The switching fabric may 
comprise, for example, a time divided communica- 
tions bus onto which digital signals are written and 
from which they are read in time slots accessed by 
two adapters that are to be connected to one another. so 
The adapters shown in Figure 1C may be of two gen- 
eral types, namely Transmission Adapters for con- 
necting to intranode or internode links and user Appli- 
cation Adapters for connecting to users of the packet 
network (TUs). The user and transmission adapters 55 
can each be mixed in any proportion at any decision 
point in any node depending only on local require- 
ments of the users. Users may be connected to the 
packet switching system at any node or subnode by 
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means of user Application Adapters as shown in Fig- 
ure 1C. 

The adapters and the switching fabric at any de- 
cision point and any node are all controlled by packet 
multicast set management facilities or programs (1) 
executed by the host computer, (2) as shown in Figure 
1C. Obviously, these functions could also be imple- 
mented in special purpose circuits, but software pro- 
grams are more flexible and more easily changed. 
The functions of user set management facilities are 
actually a group of processes which rely on data re- 
trieved from the network topology database 3 that 
contains and maintains an up-to-date record of all of 
the user resources and transmission resources avail- 
able in the entire network. Resource records in the 
network topology database are used in calculating 
transmission paths between originating and destina- 
tion user applications and in calculating distribution 
paths for interconnecting sets of users. 

Figure 1D schematically reillustrates a hypothet- 
ical network comprised of a plurality of nodes A-L in 
which the nodes may be interconnected by a plurality 
of communications links as shown to serve locally 
connected users at each node as shown. In accor- 
dance with the preferred embodiment of the inven- 
tion, each node comprises a set of management proc- 
esses or programs (1) from Figure 1C which may be 
invoked to carry out functions of being a Set Manager 
for one or more transmission users served by a given 
node, a Set Leader for an entire set of users that may 
be supported over the network comprised of a plur- 
ality of nodes, a Surrogate Set Leader when separate 
subnetworks or partitioned subnetworks have been 
rejoined or as the overall network Registrar as has 
been alluded to earlier. 

Figure 2A illustrates in a schematic fashion the 
message protocols exchanged by a Set Manager 
either with itself acting in the capacity of Surrogate 
Set Leader, Set Leader or Registrar or with other 
nodes where the Set Managers have implemented 
such functions. A given Transmission User TU as 
shown in Figure 2A wishing to enroll in a set must 
communicate its desire to join a set to its local Set 
Manager residing in the node to which the given TU 
is attached. In making such a request, the TU must 
give the group ID of the group or set of users that it 
desires to join, the requesting TU's address and an in- 
dication if any specific authorization will be required 
such as an encryption or decryption key used in com- 
municating wit h members of t he set. The TU may also 
leave or "resign from" a defined set by sending the 
group ID and its own requesting TU address to its ser- 
vicing Set Manager with an indication that it wishes 
to leave an established set having the given group ID. 
It may also send information to the set as a group mul- 
ticast with or without being a member of the set by 
sending a message to the Set Manager that it has in- 
formation to be distributed to a given set known by a 
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given set ID. 

Upon receipt of a request to join a set from a lo- 
cally supported TU, the Set Manager serving the TU 
must either know the identity of the assigned func- 
tional Set Leader for the set, learn it or assume it. 

In the preferred embodiment of the invention, 
this is achieved by having the Set Manager that hap- 
pens to be unaware of the identity of the Set Leader 
for a given identified set assert itself as a Set Leader 
by sending a message to the Registrar for the net- 
work. The identity of the Registrar of the network is 
ascertained by the Set Manager via executing code 
in one of the set management processes (1) of Figure 
1C to access the network topology database (3) to 
learn the address and location for the network Reg- 
istrar. Having ascertained the address of the network 
Registrar, the Set Manager sends an Assert Set Lea- 
dership message giving the group ID for which leader- 
ship is desired and including the requesting Set Man- 
ager's network and node identification. 

The Registrar will reply either with the identity of 
the current Set Leader forthe group ID by giving the 
current Set Leader's identity by network ID, and node 
ID or will respond with the requesting Set Manager's 
network ID and node ID, thus indicating that the re- 
questing Set Manager's has assumed Set Leader- 
ship. Also a given Set Manager may inquire whether 
a Set Leader exists for a given set by directing a mes- 
sage to the Registrar as shown schematically in Fig- 
ure 2A. The Set Leader as shown in Figure 2A may 
also assert Set Leadership or retire as the Set Leader 
by sending appropriate messages to the Registrar. 
The form and content of the message or request is 
the same as that discussed for the Set manager and 
the replies from the Registrar are of similar format 

Once the Set Leader for the identified set has 
been identified, the Set Manager must send a mes- 
sage to the Set Leader requesting the joining of its 
originally requesting TU into the set This message 
passes from the Set Manager either to the Set Leader 
or to the Set Leader acting as Surrogate Set Leader, 
whichever has been made known to the present Set 
Manager as the present Set Leader for the given set. 
The request to join a given user set includes the group 
ID of the set, the requesting TU's address and the Set 
Manager's network ID and node ID. The reply from 
the Set Leader or Surrogate Set Leader to the Set 
Manager has a reply type indication, the group or set 
identification, the Set Leader's network ID and node 
ID and a sense code as will be described in greater 
detail later. 

A request to leave the set must come from a TU 
to its Set Manager and the Set Manager transfers the 
request to the Set Leader or the Surrogate Set Lead- 
er. This request includes the group ID from which a 
transmission user wishes to resign, the requesting 
TU's address and the Set Manager's network ID and 
node ID. 



A reply from the Set Leader or Surrogate Set 
Leader includes a reply type, the set ID or group ID, 
the Set Leader's net ID and node ID and a sense code 
5 for purposes that will be described in greater detail lat- 
er. 

A given Set Leader may retire as Set Leader by 
sending an appropriate request to the network Reg- 
istrar including the Set Leader's Set Manager net ID 

10 and node ID and the group or set ID for which it wishes 
to retire as Set Leader. The reply from the Registrar 
indicates the type of reply, the group ID whose lea- 
dership will be resigned and a sense code for purpos- 
es that will be described later. 

15 Merging of subsets in the network due to reestab- 

lishment of a link whose earlier rupture may have 
caused partition of the network into subsets is ac- 
complished by forwarding a "merge set membership" 
request from a Surrogate Set Leader to the new or ac- 

20 tual original Set Leader. This request includes the set 
or group ID, the Surrogate's net ID and node ID and 
the set membership list comprised of the TU address- 
es which the Surrogate has been serving. The reply 
from the original Set Leader to the Surrogate includes 

25 a reply type, the set or group ID and a sense code for 
purposes that will be described later. 

Figure 2B illustrates the set management proto- 
col or message flows in an open set. The key in Figure 
2B illustrates both the direction of message flow and 

30 whether or not connectivity is monitored or periodical- 
ly checked. 

Figure 3 illustrates partition of a network into two 
halves, A and B, due to the breakage of a link joining 
the Registrar R1 with the Set Leader SLb for group 
35 ID1. 

Figure 4 illustrates the reconfigured subnet- 
works A and B where subnetwork B has assigned a 
new Registrar R2 and subnetwork A has assigned a 
new Set Leader SLa group ID1 in accordance with 
40 processes illustrated in the process flows that will be 
described shortly. 

All of the foregoing messages communicated be- 
tween the functionally acting Set Managers perform- 
ing the duties of Set Manager Set Leader and Reg- 
45 istrar are controlled and created in response to the 
execution of program processes at each Set Manager 
node that will be described in greater detail with ref- 
erence to Figures 5-10 which follow. 

Figure 5 illustrates the main flows of the Set Man- 
so ager operating processes at each node: Input to the 
Set Manager process comes from the topology data- 
base (TDB) from the transmission users (TU) and 
from the Set Leader and Registrar. Set Manager ini- 
tiation block 4 in Figure 5 is the starting point. 
55 When a transmission user desires to enroll in a 

user group or set, a request therefore is received by 
the Set Manager 4 and interpreted in block 5 as a re- 
quest to join the set. A check is made in block 6 as to 
whether the Set Leader is known to the Set Manager. 
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If the answer is yes, the Set Manager checks to de- 
termine if the Set Leader is actually itself in block 8. 
If the answer is no, it sends the join set request from 
its serviced TU that is desiring an enrollment in a set s 
to the known Set Leader as shown in block 10 and in 
block 11 the Set Manager marks its own list for the TU 
t hat was requesting enrollment as pending enrollment 
and awaits a join set reply from the Set Leader. This 
process then returns to the start in block 4. 10 

If, however, in block 6 the Set Leader is not 
known, block 7 is entered and a separate routine 
called the unknown Set Leader procedure in block 30 
of Figure 6 is called. This will result in identifying the 
Set Leader back to the Set Manager and will be de- 15 
scribed in greater detail later since its operation then 
flows to block 8 of Figure 5 and is processed in the 
same fashion described above. When the check in 
block 8 is made as to whether the Set Leader is the 
actual set manager, it may be found that the local Set 20 
Manager is in factthe Set Leaderfor the identified set 
which the TU is requesting to join. If the answer is yes 
in block 8, block 9 is entered and a join set enrollment 
message is sent to the Set Leader code process run- 
ning within the same node which follows the flows 25 
given in Figure 8 that will be described later. Exiting 
from block 9, the process returns to the Set Manager 
input block 4. 

If the Set Manager 4 receives from a serviced TU 
a request to resign from a set, the process enters 30 
block 12 which interprets the request as a request to 
leave the set. A check is made in clock 1 3 as to wheth- 
er the requesting TU is presently a member of the set. 
If the answer is no, a reply is generated in block 15 to 
inform the TU that it cannot leave since it is not a set 35 
member currently and the system returns to the start. 
If the TU is a member of the set, however, block 14 is 
entered and a leave set request is sent to the known 
Set Leader and a notation is made in block 16 by the 
Set Manager code for this TU as "pending a leave re- 40 
quest reply" and the system returns to the start in 
block 4. 

If the Set Manager 4 receives the necessary re- 
ply from the Set Leader to acknowledge a joining of 
the set or leaving of a set block 1 7 is entered to up- 45 
date the local Set Manger's TU membership list or 
lists for the various sets for which it may have records. 
Block 18 checks as to whether the reply is positive 
and if it is and it is a join set reply, this is detected in 
block 24. If a join set reply is present, the requesting so 
TU's identification is added to the set membership list 
maintained by the Set Manager and the Set Manager 
monitors its connectivity to the requesting TU as 
shown in block 25. In block 27 the Set Manager also 
begins monitoring connectivity to the know Set Lead- 55 
er if it is other than the present Set Manager. In block 
28 the Set Manager returns a positive enroll signal to 
the requesting TU so that it knows that it is enrolled 
in the desired set. Then the process returns to the 
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start. If the test in block 24 detects that it is not a join 
set reply, block 26 is entered and the TU is deleted 
from the membership list maintained by the Set Man- 
ger and monitoring of connectivity to the TU is ended. 
Block 29 is entered and a positive resignation request 
signal is returned to the requesting Tu so that it knows 
that it has been disenrolled from the identified set. 
Then the process returns to the start. 

If, however, in block 1 8 a negative reply is detect- 
ed, block 19 is entered to check a sense code which 
is transmitted as a part of the format of a response 
from a Set Leader or Registrar. Block 19 checks 
whether a sense code indicating that the Set Leader 
is acting as a Surrogate Set Leader is present. If the 
answer is yes, block 20 is entered and a routine is 
called to initiate the join set or leave set operations 
with a new Set Leader location that will be indicated 
by the sense code from the Surrogate Set Leader in- 
dicating who the new Set Leader actually is. If the 
sense code Surrogate Set Leader is not present in 
block 19, block 21 is entered to check whether the 
sense code indicates that the responder is not the Set 
Leader. If the answer is yes, the unknown Set Leader 
procedure block 30 is entered as shown by the in- 
struction in block 22. If the answer in block 21 is no, 
block 23 is entered and a reply is returned to the re- 
questing TU with the sense code, since it may contain 
other elements of information for the TU's use, and 
the system returns to the start. 

If a topology database update indicator is re- 
turned to the Set Manager 4, and the update indicates 
that a Set Leader has failed or connectivity has been 
lost, block 41 is entered which invokes the unknown 
Set Leader procedure in block 30 of Figure 6 which, 
when it is completed, returns at point B and enters 
block 42 where the join set for local set membership 
is performed and local set membership records will 
be maintained by the newly identified Set Leader and 
the system returns to the start. 

In Figure 6, the procedure for identifying and es- 
tablishing a new Set Leader is set forth. The system 
begins in block 30 where Set Manager queries the to- 
pology database for the location and identity of the 
Registrar. Block 31 is where the response from the 
topdlogy database is examined to determine if a Reg- 
istrar exists, if a Registrar exists, block 32 is entered 
and a set leadership assertion request is sent to the 
known Registrar by the Set Manager. If a positive re- 
ply is not received in block 33, block 30 is reentered 
to learn the identity of the known Registrar, but if a 
positive reply is found in block 33, block 34 is entered 
and the reply is checked to determine if another Set 
Leader exists for the set If the answer is yes, block 
35 is entered where the Set Leader information is re- 
corded by the Set Manager and the process returns 
to the Set Manager processing code at the point call- 
ing the unknown Set Leader procedure initially. 
If another Set Leader does not exist for the set in 
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block 34, then block 36 is entered where the Set Man- 
ager records the known Registrar's information and in 
block 37 the Set Manager becomes the Set Leader 
and initiates the become the Set Leader startup code 
of Figure 7 and then returns to the Set Manager ini- 
tiation in block 4 of Figure 5. 

If the check in block 31 of Figure 6 shows that no 
Registrar exists, the Set Manager must become the 
Registrar and block 38 is entered which calls the Reg- 
istrar startup initiation procedure of Figure 9 that will 
be discussed later. Block 39 is then entered and the 
assert set leadership message is sent to the Registrar 
process code within the Set Manager station and in 
block 40 it becomes the Set Leader by calling the Set 
Leader startup code of Figure 8 and then exits in 
block 43 to return to point B at block 42 of Figure 5. 
At this point, the Set Manager has assumed the re- 
sponsibility of being the Registrar for the network, 
the Set Leader for the set and the Set Manager for 
any local attached TUs which it services. 

Figure 7 shows the various Set Manager startup 
procedures for becoming Set Leader (block 43), net- 
work Registrar (block 102) or Surrogate Set Leader 
(block 106). In block 43 the process for the Set Man- 
ager to become a Set Leader is initiated. In block 44 
it monitors connectivity to the known Registrar and in 
block 45 returns to the Set Leader process which is 
initiated in Figure 8 (that will be discussed later) 
where it enters block 46. 

If the Set Manager is to become the network 
Registrar, block 102 is entered for startup of this proc- 
ess. In block 103 the Set Manager sends to the net- 
work a topology database update message indicating 
that this Set Manager is becoming the Registrar for 
the network as shown in block 103. The Registrar 
then monitors the topology database to determine if 
any other Set Managers have registered as Registrar 
in block 104. In block 105, having initiated the Regis- 
trar startup procedure, the Set Manager enters Figure 
9 to be the Registrar. 

In block 106, the Surrogate Set Leader startup 
procedure is invoked which records (block 107) the 
new Set Leader information received from the topol- 
ogy database or the Registrar upon joining of two pre- 
viously separated subnetworks in which the new Set 
Leader has been identified. The Surrogate Set Lead- 
er then monitors (block 108) its connectivity to the 
new Set Leader and acts as Surrogate Set Leader by 
sending a merge set membership list to the new Set 
Leader in block 109. It then returns to the Surrogate 
process in Figure 10 as shown by block 110. 

Figure 8 illustrates the process for the Set Man- 
ager becoming a Set Leader and begins in block 46 
with input from the topology database, the Set Man- 
ager or the Registrar. The input is examined and in 
block 46 it determines that a join set request has been 
received from a Set Manager In block 47 a check is 
made as to whether t he requesting TU is already a set 
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member. If the answer is yes, block 51 returns a pos- 
itive reply to the Set Manager indicating that the re- 
questor is already a member and the process returns 

5 to block 46. If the requesting TU is not already a set 
member, block 48 is entered and the requesting TU 
is added to the set membership list by the Set Leader. 
If a new Set Manager is indicated in the information 
received from the Set Manger requesting enrollment 

10 of a Tu as a set member, block 49 will indicate this and 
the Set Leader will then monitor for connectivity to the 
newly identified Set Manager. A positive reply will be 
returned in block 50 and the operation returns to 
block 46. 

15 If a ^ave set 1 * request is received by the Set 

Leader from a Set Manager it is checked in block 52 
to determine whether the affected TU is already a set 
member. If the answer is yes, block 53 is entered and 
the TU is deleted from the set membership list main- 

20 tained by the Set Leader. In block 54 a positive reply 
is returned to the Set Manager to indicate that its re- 
quest has been accepted and block 55 is entered. In 
block 55 a check is made by the Set Leader to deter- 
mine if the last transmission unit identified with the re- 

25 questing Set Manager has been deleted and if the an- 
swer is yes, block 56 is entered and the Set Manager 
is deleted from the list and monitoring of connectivity 
to that Set Manager is ended. A check is also made 
to determine, in block 57, if the set membership list is 

30 empty and if the answer is yes, block 58 is entered 
and the Set Leader sends a retire request to the net- 
work Registrar indicating that the Set Leader for the 
identified set wishes to resign and the Set Leader 
process is ended in block 59. If, however, the set 

35 membership list is not empty the system merely re- 
turns to the beginning block 46. If the requesting TU 
has not been found to be a set member in the check 
in block 52, a negative reply is returned to the set 
manager indicating, by a sense code, that the re- 

40 questing TU is not a member of the set as shown in 
block 60. The system then returns to the start at block 
46. 

If the Set Leader receives a merge set member- 
ship request from another Set Leader, block 61 up- 

45 dates the set membership list with new members 
identified by the request for merging the lists. It re- 
turns a positive reply in block 62 and then the opera- 
tion returns to the start at block 46. 

If the Set Leader receives a topology database 

so update indicating that a Set manager has failed or 
connectivity has been lost to a Set Manager associ- 
ated with any of the set members for which this Set 
Manager is Set Leader, block 63 is entered where the 
Set Leader deletes the Set Manager and all of its set 

55 members from the lists that it maintains and it stops 
monitoring the connectivity to that Set Manager. 
Block 64 is then entered to determine if the set mem- 
bership list for the affected set is empty. If the answer 
is yes, the Set Leader sends a retire request to the 
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network Registrar as shown in block 65 and the Set 
Leader process ends in block 66. If the set member- 
ship list is not empty, then the Set Leader must con- 
tinue to be a leader and merely returns to block 46 as 5 
shown at the output of block 64 where the no condi- 
tion is found. 

When the Set Leader receives a topology data- 
base update indicating that a Registrar has failed or 
that connectivity to the Registrar has been lost or 10 
there ts no longer a known Registrar, block 67 is en- 
tered In block 67 the unknown Registrar procedure is 
called and an nqutf y of the topology database for the 
known Registrar rs made. The response from the to- 
pology catabase ts checked in block 68 to determine 15 
if the Registrar ettsts V the answer is yes, block 69 
is entered and a a**ert *e: leadership message sent 
toth**rx>*n h ^^sftm %o that the Set Leader can de- 
termine I < corttnu* io be the Set Leader. If a pos- 
itive rc&y t% received *n t*od 70, a check is made to 20 
determine 4 a«ot r*m Set leader exists and if no other 
Set Lead** #n%ts a* %nowr m block 71 , block 73 is en- 
tered and present Set Leader remains the Set 
Leader by return*-^ to t*x* 46. If, however, block 70 
does not st*** th**t * putMiwe reply has been received 25 
to the a*M*i»on of set leadership, block 67 is reen- 
tered to oviwmir** wfio the Registrar may be and to 
again inquve. etc Eventually a positive reply will be 
received, eit he* when a Registrar has been created or 
the present Set Leader Set Manager also becomes a 30 
Registrar as wilt shortly be described. If another Set 
Leader is identified in block 71, block 72 is entered 
and the Set Leader becomes a Surrogate Set Leader 
for its set and it calls t he Surrogate Set Leader startup 
procedure of Figure 10 and then returns to the start 35 
at 46. 

If no Registrar is found to exist in block 68, block 
74 is entered and the Set Leader becomes the Reg- 
istrar by calling the Registrar startup procedure of 
Figure 7 at block 102 of Figure 7 and then block 75 is 40 
entered where message asserting set leadership and 
listing the set membership is sent to the Registrar 
code portion invoked at the Set Manager and return 
to block 46 occurs as shown. 

In Figure 9, the operations of a Set Manager per- 45 
forming the duties of Registrar are shown beginning 
at block 76. Input to the Registrar can come from the 
topology database, a TU via Set Leader or Set Man- 
ager as shown. If the Registrar receives a topology 
database update indicating that one or more other 50 
Registrars exist in the network, an intolerable situa- 
tion since only a single Registrar per network is per- 
mitted, block 77 is entered. In block 77 the Registrar 
checks whether its own identification is the highest 
priority one among all of the Registrars indicated to 55 
exist. Arbitrary means for determining the priority 
such as having the highest alphanumeric address, 
being the first Registrar listed or requesting the priv- 
ilege of being Registrar, the longest acting Registrar 



or any other criteria may be used. In the preferred em- 
bodiment, it is simplest to use a comparison of the al- 
phanumeric addresses and choose the address hav- 
ing the highest alphanumeric value to be the success- 
ful Registrar. Such a test is conducted in block 77 and 
if the answer is M yes M , then the present Set Manager 
remains the Registrar as shown in block 78. If the test 
in block 77 shows that the present Registrar does not 
have priority, it sends a message to the topology da- 
tabase as an update indicating that it is no longer 
Registrar as shown in block 79 and it ends the Reg- 
istrar process in block 80. 

If the Registrar receives an assertion of set mem- 
bership request from a Set Leader or from a Set Man- 
ager, it checks in block 81 to determine if a Set Leader 
exists for the identified group ID of the set present in 
the assertion of set membership request. If no Set 
Leader exists, block 82 is entered and the requesting 
Set Manager is listed as the Set Leaderfor the set and 
the information for the Set Manager is added to the 
Set Leader list In block 83 a positive reply is sent in- 
dicating to the requesting Set Manager that it will be- 
come the Set Leader. The system then returns to the 
input at block 76. If a Set Leader already exists for the 
identified group as shown at the output of block 81, 
block 84 is entered to determine whether the Set 
Manager's net ID and node ID are the same as the 
Set Leader's, i.e. whether the requesting Set Man- 
ager is already the Set Leaderfor the given set. If the 
answer is yes, block 85 is entered and the Registrar 
updates the Set Leader information and returns a 
positive reply with the Set Leader's information in 
block 86. If the Set Manager's address is not the 
same as the Set Leader's for the identified set, block 
91 is entered and a positive reply is returned together 
with the identification of who the current Set Leader 
actually is. 

If the Registrar receives a request to retire from 
a Set leader a check is made in block 87 to determine 
if the requesting Set Leader is registered for the iden- 
tified set or group identification. If the answer is no, 
a negative reply that the Set Leader requesting res- 
ignation is not a Set Leader is given in block 88. If the 
Set Leader is the registered one for the identified 
group, block 89 is entered and the Set Leader's infor- 
mation is deleted as requested and the Registrar 
stops monitoring for connectivity to this Set Leader. 
It sends a positive reply in block 90 and returns to the 
beginning block 76. 

If the Registrar receives a topology database up- 
date indicating that a Set Leader has failed or that 
connectivity to a Set Leader has been lost, block 92 
is entered where the Registrar deletes the Set Lead- 
er's information and stops monitoring for connectivity 
to that Set Leader. 

In Figure 10, the Surrogate Set Leader's process 
code flow is described as it responds to input from the 
topology database, the Set Leader or the Set Man- 
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ager. The Surrogate Set Leader (block 93) may re- 
ceive a request to join a set or to leave a set from a 
TU serviced by a Set Manager. If such a request is re- 
ceived, block 94 is entered and the Surrogate Set 
Leader returns a negative reply with the actual new 
Set Leader's identification. It then deletes the re- 
questing Set Manager and all of its listed TUs as set 
members as shown in block 95 and since Set Man- 
ager now knows who the actual Set Leader is and 
since the new Set Leader has that information and 
has assumed this responsibility. The check is made 
in block 96 to determine if the set membership list is 
empty at the Surrogate Set Leader and if it is, then 
the Surrogate process is ended in block 97, but if not, 
the process returns to block 93. 

If the Surrogate Set Leader receives a topology 
update message indicating that a Set Manager has 
failed or lost connectivity, it enters block 95 directly 
and the process flows as already described. 

If the Surrogate Set Leader receives a topology 
database update indicating that a Set Leader has 
failed or lost connectivity or if it receives a negative re- 
ply to a merge set membership command it ends the 
Surrogate process in block 98, becomes the Set 
Leader in block 99 and calls the unknown Registrar 
procedure as shown in block 100. The unknown Reg- 
istrar procedure begins at block 67 in Figure 8 and op- 
erates as already described. If the Surrogate Set 
Leader receives a merge set membership request, re- 
turns a negative reply as shown in block 101 with the 
Set Leader's actual location and address information 
and then returns to block 93. 

As can be seen from the foregoing operations, 
the set management process provides an ability to 
form a set of users and provides efficient communi- 
cations to the set of users via a multicast routine 
which allows any one entity to communicate with mul- 
tiple users. Packet delivery to a set of TUs without 
having to broadcast to all TUs in the network or by 
having to separately transmit copies of packets to 
each TU in a set is made possible by having the indi- 
vidual nodes with the managed set of responsibilities 
described above. The Set Manager is the key element 
in this system and it resides in each of the nodes as 
already described. It provides locally serviced TUs 
with multicast service and with distribution service if 
messages are received for locally serviced TUs. The 
Set Manager protocols or processes are distributed 
among the nodes as shown and allow the formation 
of a set of users and provide an efficient mechanism 
for communications among the members of the set or 
to the set from outside of the set. 

The Registrar function is the centralized informa- 
tion base for open sets and its identity is globally 
known throughout the network. In an open set, TUs 
may independently join or leave the set. The set is 
created when the first TU joins or establishes the set 
and is destroyed when the last set member leaves. 



One Set Manager is designated as a Set Leader 
for the set and maintains a listing of all of the set mem- 
bers; it is registered with the Registrar. The Set Lea- 

5 dership, the set membership and the Registrar's 
identity are all dynamic and may be changed at any 
time or as the situations within the network dictate. 
Sets are identified by group or set identification estab- 
lished by the TU or Set Manager creating a set. An 

10 open set will survive a partition of the network due to 
failure of some interconnecting link by the recovery 
mechanisms described above in which subset Regis- 
trar and Set Leaders are created automatically by the 
processes that have been outlined. For closed sets, 

15 membership is defined by the initiating TU and no 
other TUs may join or communicate with the mem- 
bers of the set. A closed set is not known globally in 
the network and the Set Leader is not registered with 
the Registrar. The initiating TU causes creation and 

20 destruction of a closed set at will and it defines the set 
membership that wHI be permitted. The initiating TU's 
Set Manager is the Set Leader for the closed set and 
maintains the set membership list. Closed sets will 
not survive network partitions since the information 

25 as to the membership of a set is not shared. 

As shown in Figure 2B, set management proto- 
cols have been established as shown in detafl in Fig- 
ures 5-10 for all of the functions and operations that 
are desired. For example, when a TU, such as shown 

30 in Figure 2B, desires to join an open set, it provides 
its Set Manager (SM) with the group ID which identi- 
fies the set that the TU wishes to join. The SM deter- 
mines the location of the Set Leader under several 
different cases. If the Set Manager has the Set Lead- 

35 er's location already cached and known to it, it merely 
sends a join message to the known Set Leader. How- 
ever, if the Set Manager does not know the current 
Set Leader or its location, the SM checks the topology 
database for the location and identity of the Registrar 

40 for the network. If the Registrar is found to exist, the 
Set Manager sends as assert set leadership message 
to the Registrar which says if there is no Set Leader 
for this group, then designate the requesting Set 
Manager as the Set Leader but otherwise return the 

45 proper Set Leader's information to the Set Manager. 
If a Set Leader exists t he Set Manager will send a join 
message to the identified Set Leader; if not, it will be- 
come the Set Leader and add the requesting TU to its 
set membership list. If the Set Manager does not 

so know the Set Leader's location and/or there is no 
Registrar, then the Set Manager will become the Reg- 
istrar and the Set Leader and will send a topology up- 
date message indicating that it has become Registrar. 
The flows of these messages under the various con- 

55 ditions noted are shown in Figure 2B in a schematic 
way. If a network partition occurs as shown in Figure 
3, then a recovery process is invoked and results in 
a network configuration shown in Figure 4. 

As shown in Figure 3, there is one set which has 

10 
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three members, TUx, TUy and TUz and a Set Leader 
SLb group ID1 and a Registrar R1. If the link, for ex- 
ample the link between R1 and the Set Leader SLb 
group ID1 fails, partition A as shown in Figure 3 loses 5 
its Set Leader but partition B loses its Registrar. There 
must be one Registrar per network or subnetwork if 
a network is divided by partition. There must also be 
one Set Leader per set. This situation is resolved as 
shown in Figure 4. A new Registrar is created in sub- w 
network B and a new Set Leader is automatically cre- 
ated in subnetwork A according to the flows and proc- 
esses invoked by the monitoring of connectivity as 
shown previously in Figures 5-10. 

When the network partitions A and B regain con- 15 
nectivity, the topology for the partitions must be ex- 
changed and since there can only be one Registrar 
per network, the Registrar having lower priority (in 
the case of the preferred embodiment the one having 
the lower alphanumeric address or name) sends a to- 20 
pology update message indicating that it will no lon- 
ger be the Registrar. Detecting the loss of its Regis- 
trar, the Set Leader in the network partition B would 
have become a Surrogate in its partition of the net- 
work and be the Set Leader to all of the members in 25 
the old partition, namely TUy and TUz. The Surrogate 
function minimizes disruption caused when the net- 
work partitions regain connectivity. Instead of each 
Set Manager sending an assert set leadership mes- 
sage to the established Registrar to determine the 30 
Set Leader's location, and a join message to the new 
Set Leader, the old Set Leader sends only one mes- 
sage which contains its set membership to the new 
Set Leader. At this time, the new Set Leader SLa, 
group ID1 has the complete set membership list. Old 35 
set members TUy and TUz think that their Set Leader 
is in partition B as SLb group ID1. Whenever the Set 
Managers for TUy or TUz perform a join, a leave or a 
send information for one of their locally serviced TUs, 
the Surrogate Set Leader SLb informs the Set Man- 40 
ager that it is no longer the Set Leader (after rejoining 
of the subnetworks) and sends, instead, the new Set 
Leader's location. 

This method of operation allows open multicast 
sets to survive network partitions automatically and 45 
spreads over time network control messages flowing 
to and from the network Registrar, the Set Leader and 
the set members when connectivity of the network 
partitions is regained. This avoids generating a tre- 
mendous network control traffic surge at the instant so 
that connectivity is regained. The Registrar function 
allows TUs in the network to locate open multicast 
sets. The Registrar is dynamically selected and iden- 
tified in the topology database. Set Leaders register 
themselves with the Registrar and transport users 55 
seeking information a bout open sets request informa- 
tion via their Set Managers from the Registrar. 

Therefore, it appears that in the improved net- 
work of the present invention, management of the en- 



tire network can be implemented in a distributed man- 
ner with the plural nodes performing the specific 
functions but working together cooperatively to pro- 
vide the overall function of network management in 
which each node has a Set Manager acting on behalf 
of its various supported transport users and/or serv- 
ing as Set Leader or even Registrar depending upon 
the specific conditions prevalent at the time. 

It will be seen, therefore, that what has been de- 
scribed as a new form of network communications 
management, a new form of communications net- 
work itself, and a new network management techni- 
que, all of which may be implemented in any of a va- 
riety of network nodes having the basic processing 
capability of a processor (or host) as described with 
relation to Figure 1 A and the necessary switching or 
routing node hardware and software. As shown with 
regard to Figures 1B and 1C, the interconnections 
among nodes may be in any graphically represented 
scheme such as indicated by Figures 1D or 3 and 4. 
It will therefore be apparent to those of skill in the art 
that numerous departures from the implementation 
details may be made without departing from the gen- 
eral spirit and scope of the new network, network 
management and network control as described with 
regard to the preferred embodiment of the current in- 
vention, wherefore the claims which are appended 
hereto are intended to be by way of description and 
not by way of limitation. 



Claims 

1 . A communications network management system 
including a plurality of interconnected nodes, 
characterized in that it comprises : 
communications control means for providing a 
plurality of selectable controls including commu- 
nications network user Set Manager control 
means, Set Leader control means and network 
Registrar control means; and 
management mode control means at each said 
node of said network and communicating with 
each network user at said node and responsive 
to the dynamic communications requirements of 
said users for selecting the mode of operation of 
said communication control means to exercise 
said network user Set Manager control means, 
said Set Leader control means and said network 
Registrar control means so that said network has 
active at any time only one said Registrar control 
means, one Set Manager control means per node 
in said network and one said Set Leader control 
means per set of users. 

2. The communications network management sys- 
tem according to claim 1, wherein: 

said user Set Manager control means further 
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comprises means for creating a set identification 
when the first said user requests joining a set for 
which no other set members are known and for 
destroying said set identification when the last 
said user resigns therefrom. 



5 



monitoring connectivity from each node to the Set 
Leader's of any user sets for which said node has 
attached users and establishing new network 
Registrar and Set Leader identities whenever a 
failure in connectivity is detected. 



3. The communications network management sys- 
tem according to any one of the preceding claims, 



said Set Leader means further comprises means 
for creating and maintaining a current list of all 
users tnat are members of said set 

4. The comrmjrftcations network management sys- 1 5 
tern according to any one of the preceding claims, 
wneretn 

sarf rx*wc*l Neg*strar means further comprises 
mean* for creatrxj and maintaining a master list 
of ai current user m*s and their members in dud- 20 
ed *n said ne^wcrk 

5. The communications network management sys- 
tem according tc any one of the preceding claims 
wherein 25 
said usee SH M<*n<*y«?f control means further 
comprise* it wans fur receiving messages des- 
tined for an identified set of users and for query- 
ing said Set Leader for said members of said set 

for the identity of said set members for delivery 30 
of said message there to. 

6. A communications network having a plurality of 
interconnected nodes characterized in that it in- 
cludes the communication network management 35 
system according to any one of the preceding 
claims. 

7. A communications network management meth- 
od, in a network having a plurality of intercon- 40 
nected nodes, characterized in that it comprises 

the steps of 

determining a network Registrar by querying a 
network database to determine if a Registrar al- 
ready exists and becoming Registrar if no other 45 
node identified as Registrar has a higher priority 
claim thereto: and 

determining for each identified set of users a Set 
Leader by sending to said Registrar a message 
identifying the sending node as claimant of set so 
leader ship for said identified set and of respond- 
ing from said Registrar with the node identifica- 
tion of the Set Leader if one already exists or with 
a response designating said requesting node as 
the Set Leader if no other Set Leader already ex- 55 



8. The method of claim 7 further comprising the 
step at each node of: 



wherein: 
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